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ABSTRACT 

For  the  monotone  nonlinear  complementarity  problem, -we  consider^Ti- 
honov  regularizations  which  reduce  the  solution  of  the  problem  to  the  so¬ 
lution  of  a  sequence  of  strongly  monotone  complementarity  problems.  The 
sequence  of  solutions  obtained  are  called  approximate  solutions  and  it  is 
known  that  for  a  solvable  monotone  complementarity  problem,  the  approxi¬ 
mate  solutions  converge  to  the  least  two  norm  solution  of  the  given  problem. 
This  paper  provides  new  growth  rates  for  these  approximate  solutions,  sharp- 
ens  some  previously  known  results  and  gives  a^procedure  for  obtaining  an 
approximate  solution  for  any  apriori  prescribed  tolerance.  /{jM, 
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SIGNIFICANCE  AND  EXPLANATION 


Tihonov  regularization  is  a  useful  computational  procedure  for  mono¬ 
tone  complementarity  problems  which  leads  to  approximate  solutions  when 
the  given  problem  is  solvable.  Growth  rates  are  given  for  these  approximants 
which  sharpen  some  known  results.  These  results  provide  a  unified  frame¬ 
work  for  finding  approximate  solutions  of  important  classes  of  constrained 
optimization  problems. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 


summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 


A  NOTE  ON  LEAST  TWO  NORM  SOLUTIONS 
OF  MONOTONE  COMPLEMENTARITY  PROBLEMS 

P.  K.  Subramanian 

1.  Introduction 

Given  an  operator  F:  9?n  — ♦  ,  the  celebrated  complementarity  problem 
NLCP(F)  consists  in  finding  z  >  0  such  that  F(z)  >  0  and  zTF(z)  —  0. 
We  say  F  is  monotone  if 

(P(x)  -  F(y))T(x  -  y)  >  0,  Vx,ye»n, 

and  strongly  monotone  with  modulus  A  if 

(F(x)  -  F(y))T[x  -  y)  >  A||x  -  y||2 

for  some  real  number  A  >  0.  When  F  is  an  affine  operator,  that  is,  F(x)  = 
Mx  +  q  for  some  nxn  matrix  M  and  a  vector  q  6  fftn  ,  NLCP(F)  is  referred 
to  as  the  linear  complementarity  problem  and  denoted  by  LCP(M,  y) .  It  is 
well  known  that  if  M  is  positive  semidefinite  and  LCP(M,  q)  is  feasible,  that 
is  there  exists  a  z  >  0  such  that  F(z)  >  0,then  it  is  solvable  [Eaves,  1971]. 
However  this  is  known  to  be  false  for  NLCP(F)  in  general  as  shown  by  the 
Sponsored  by  the  United  States  Army  under  Contract  No.  DAAG29- 
80-C-0041.  This  material  is  based  on  work  sponsored  by  National  Science 
Foundation  Grants  DCR-8420963  and  MCS-8102684. 


counterexample  of  [Megiddo,  1977]  and  [Garcia,  1977]  .  On  the  other  hand, 
if  F  is  monotone  and  satisfies  some  growth  conditions  to  be  defined  below 
or  the  distributed  Slater  constraint  qualification  [Mangas arian  &  McLinden, 
1985],  then  NLCP(F)  is  solvable. 

In  this  note  we  shall  be  concerned  with  NLCP(F)  when  F  is  monotone 
and  the  complementarity  problem  in  this  case  will  be  referred  to  as  the 
monotone  complementarity  problem.  For  such  an  operator  F,  given  e  >  0, 
the  Tihonov  regularization  of  F  is  defined  to  be  Fe  :=  F  +  el.  It  is  well 
known  that  NLCP(Fc)  has  a  unique  solution  x(e).  The  prinicpal  theorem 
of  this  note  provides  new  growth  rates  for  ||x(e)||.  As  a  corollary,  we  obtain 
the  well  known  result  x(e)  — >  x*  where  x*  is  the  least  two-norm  solution  of 
NLCP{F)  ,  provided  NLCP(F)  is  solvable.  These  growth  rates  are  also 
useful  in  obtaining  6-approximate  solutions  when  NLCP{F)  needs  only  to 
be  solved  within  a  preassigned  tolerance  6  in  some  special  cases. 

We  briefly  indicate  the  notation  used  in  this  paper.  We  denote  by 
the  space  of  real  ordered  n-tuples.  We  use  the  Euclidean  two-norm 
throughout.  All  vectors  are  column  vectors.  Given  a  vector  x,  we  indi¬ 
cate  its  ith  component  by  x*.  We  say  x  >  0  if  one  has  x*  >  OVi  and  the  set 
of  all  such  vectors  in  3?n  is  denoted  by  9?”  .  Given  x,y  in  9 ?n  ,  we  shall 
indicate  their  inner  product  xTy  by  <  x,y  >  .  Given  NLCP(F)  ,  we  define 
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its  feasible  set  S(F)  and  solution  set  S(F)  by 

S{F)  =  {xe  SR”  :  F(x)  6^} 

S(F)  =  {x  6  S(F)  :<  x,F(x )  >=  0}. 

The  end  of  a  proof  is  indicated  by  |. 

2.  Variational  inequalities  and  NLCP(F) 

The  following  notions  are  essential  for  this  paper  and  the  reader  is  referred 
to  [Auslender,  1976]  for  proofs. 

2.1  Definition.  Let  D  C  SR”,  F:D  — *  SR”.  The  variational  inequality  prob¬ 
lem  consists  in  finding  za  €  D,  if  it  exists,  such  that 

<  F(z0),  x  -  z0  >  >  0  Vx  6  D. 

In  this  case  we  say  that  z0  solves  the  variational  inequality 

(VI)  :  <  F(z),  x  -  z  >  >  0  Vx  €  D. 

Although  many  problems  can  be  cast  as  variational  inequality  problems, 
our  interest  in  them  stems  from  the  following  well  known  proposition  (see 
e.g.,  [Karamardian,  1972]). 

2.2  Proposition.  Let  F:SR”  — ♦  SR”.  Then  z0  solves  NLCP{F)  if  and  only 
if  z0  solves  (VI). 

2.3  Definition.  Let  C  be  a  closed  convex  set  in  SR”,  and  let  F:$ln  — »  SR”. 
We  say  F  is  hemi continuous  on  C  if  for  all  x,  y  G  C,  the  map 


X 


<  F(Xx  +  (1  -  X)y),  x  -  y  > 


16  continuous  on  the  interval  [0,  l]. 


2.4  Proposition.  Let  C  be  a  closed  convex  set  contained  in  D  and  let 


F :  D  — ►  S?”  be  monotone  and  hemi continuous  on  C .  Then 


<  F(z *),  (z-z*)>  >  0  Vz  €  C 


if  and  only  if 


<  F(z),  (z-z*)>  >  0  Vz  e  c 


Further,  Z0  =  {z*  :  z*  solves  (4.5)}  is  closed  and  convex. 


See  Auslender  [1976,  page  121]  for  a  proof. 


2.6  Definition.  Let  C  C  D  be  a  nonempty  closed  convex  set  and  assume 


F:D  — >  9?n.  We  say  F  is  coercive  (strongly  coercive)  if  there  exist  v0  6 


C,  A  €  5R  positive  such  that 


v  e  C,  |M|  >  A  =>  F(v)(t;  -  v0)  >  0 


(respectively, 


v  €  C,  ||r||  — >  oo 


F(v)(v-v<>) 


V  -  Vo 


+oo). 


The  proof  of  the  following  Theorem  may  be  found  in  [Auslender,  1976]. 


2.7  Theorem.  Let  F  :  Rn  — ♦  3in  be  a  monotone  operator,  coercive  and 


hemiconintuous  on  9?" .  Then  NLCP(F)  is  solvable.  If  in  addition  F  is 


strongly  coercive,  then  NLCP(F)  has  a  unique  solution. 


We  now  define  the  Tihonov  regularization  of  an  operator. 


S' 


'**<*"'  .V.’&nV',1 


V  *  » «  Wt-I.v. 


Wva 
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2.8  Definition.  Let  F  :  9?”  — ♦  9fcn  and  let  e  >  0.  The  Tihonov  regular¬ 
ization  Fc  of  F  is  defined  by  Ft(x)  =  F( x)  +  fi. 

If  F  :  SR”  — ►  Sn  is  monotone  and  hemicontinuous,  then  Fe  is  also  hemi- 
continuous  and  strongly  monotone  with  modulus  of  monotonicity  at  least  e. 
It  is  immediate  that  Fe  is  strongly  coercive.  Thus  we  get  the  following  useful 
corollary  to  Theorem  2.7. 

2.9  Corollary.  Let  F  :  9in  — *  9?"  be  monotone  and  hemicontinuous.  Then 
Ve  >  0,  there  exists  a  unique  x(e)  (called  e-approximant  or  simply  approxi- 
mant),  which  solves  NLC P(F). 


3.  Properties  of  approximants 

In  this  section  we  shall  prove  the  principal  theorems  of  this  paper  on  the 
growth  rate  of  oapproximants. 


3.1  Theorem.  Let  F  :  9in  — »  9 ln  be  a  monotone  operator  which  is  hemicon¬ 
tinuous  on  9?"  .  Let  {£n}  be  a  sequence  of  positive  reals  such  that  en  |  0.  Let 
Fn  =  F  +  en  /  be  the  Tihonov  regularization  of  F  and  let  xn  be  the  unique 


solution  of  N LCP(Fn).  Let  m  >  n  and  assume  that  F( 0)  2  0-  Then 


\Xm~Xn\r  < 


|2  <  _ £inl 

(en  +  em) 


Proof 

From  Proposition  2.2,  it  follows  that 

^  X  Xm  ^  0  Vi  6  9?”. 


By  taking  x  =  xn, 


<  Fm(Xm),  %n  ~  %m  >  ^  0. 


Likewise, 


^  F n(^f»)?  Im  0» 

which  we  rewrite  as 

<  ~Fn(xn),  xn  —  xm  >  >  0. 


Adding  (3.2)  and  (3.3)  we  get 


<  ^m^m)  Fn(xn),  Xn  Xm  >  ^  0. 


Hence  remembering  that  Fm  =  F  ■+  em  /, 

<  F{Xm)  +  Emlm  ~  ^(in)  ~  Xn  -  Xm  >  >  0. 

From  the  monotonicity  of  F  this  yields 

<  fm^m  EwIni  %n  ^  ^  <  F(zn)  F^Xm),  Xn  —  Xm  >  ^  0 

that  is, 

£m  ^  3Cm  —  ^  ~h  (^m  En)  ^  Iid  Xm  >  ^  0. 

By  assumption  m  >  n  so  that  s*,  <  sn*  We  now  have 

(^n  em)  ^  Ini  ^  ^  £m||^m  £n||^-  (3.4) 
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Obviously, 

||Xm||  =  ||^m  Xn||  "f"  ||Xn||  "h  2  <  Xm  —  Xn,  Xn  > 

so  that  from  (3.4)  we  now  get 


This  completes  our  proof.  | 

Theorem  3.1  has  some  interesting  consequences.  We  present  them  in 
the  following  corollary. 

3.5  Corollary.  Assume  that  the  hypotheses  of  Theorem  it.l  are  satisfied. 
Then 

a)  ||*m||  >  ||xn|! 

b)  £m||zm||  <  £n||Xn|| 

Let  S  —  {x  :  x  solves  NLCP(F)}.  Then 

c)  SUp{||x„||}  <  00  <=>  Xn  - ♦  X  =  P§(0)  <=>S  ^ 

where  P§{ 0)  denotes  the  projection  of  the  origin  on  S(F),  that  is  the  closest 
point  to  0  in  S{F)  in  the  two-norm. 

Proof 

Observe  that  m  >  n  implies  that  xm  ^  zn.  To  see  this,  suppose  the 
contrary  and  write  zm  =  zn  =  x.  Then  z  solves  NLCP(Fi)  for  i  =  m,  n 


<  F(x)  +  emx,  x  >  =  0 


<  /’(x)  +  enx ,  x  >  =  0 

which  imply  <  emx  ~  enx,  x  >  =  0.  Since  em  <  en  we  must  have 

x  =  0.  But  Fm(x)  >  0,  so  that  we  must  have  F( 0)  >  0  contradicting 
our  hypothesis.  Hence  ||xm  —  xn||  >  0  and  (a)  follows  from  Theorem  3.1. 
Next  we  prove  (b).  By  Cauchy-Schwarz  inequality  a:;n  (3.4), 

— - —  ||x«||||xm  -  x„||  >  ||xm-xn||2. 

em 


Hence 


xn  )  ^  ^n||  xm  ~  xn\ 


This  proves  (b). 

Finally  we  prove  (c). 

We  start  by  showing  that  {)|xn||}  bounded  =>•  xn  converges  to  an 
element  of  5.  From  (a),  since  {||xn||}  is  strictly  increasing,  sup||xn||  = 
lim||xn||.  Taking  m  >  n  and  letting  m,  n  — ►  oo,  it  follows  from  Theorem 
3.1that  {xn}  is  Cauchy.  Hence  xn  converges.  Let  x„  — »  £.  Since  xn  solves 
NLCP(Fn), 


xn  >  0,  Fn(xn)  >  0,  <  xn,  Fn(xn)  >  —  0 


r ». !  i  -v  vjv  >  -v  l"^-  v ~v  \  «.■■  v^rr-^. 


ST^rrTCTvncrrrrTn 


l  ^  7  ^  W*  ■  V  ^  i  TTTT*^ 


which  implies 


i  >  0,  F(t)  >  0,  ,<  e,  Fti)  >  =  0 


so  that  f  £  5. 

On  the  other  hand,  if  5  ^  0,  let  2  be  any  arbitrary  element  of  S. 

Assume  that  n  is  arbitrary  but  fixed.  By  Proposition  (2.2), 


<  Fn(i„),  x  -  xn  >  >  0 


V x  £  SR”. 


Take  x  —  z  to  get 


<  F(xn)  +  enin,  2-  xn>  >  0. 


(3.6a) 


MS 


Since  2  solves  NLCP(F),  by  Proposition  (2.4), 


<  F(i),  x  -  z  >  >  0  Vi  £  5R” 


Taking  x  =  xT 


<  F(xn),  xn  -  z  >  >  0. 


From  (3.6a)  and  (3.6b)  we  get 


(3.66) 


£ri  ^  Xfi,  Z  Xn  ^  0 


(3.7) 


so  that  <  xn,  z  >  >  ||zn||2.  Hence  ||zn||  <  ||«||,  that  is,  supn  ||xn||  is 

bounded  proving  the  converse. 
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It  remains  only  to  show  that  if  xn  — ♦  (  then  £  =  P§( 0).  But  from 
(3.7)  we  have  <  f,  z  -  £  >  >  0  and  since  z  was  an  arbitrary  element  of  S 
it  follows  that  £  =  P§{ 0).  This  completes  the  proof.  | 


Remark 


Parts  (a)  and  (c)  of  Corollary  3.5  are  known  when  F  is  a  multifunction  on 
a  Hilbert  space  H.  For  a  proof  using  the  theory  of  Yosida  approximations, 
see  [Brezis,  1974],  who  also  proves  a  weaker  form  of  Theorem  3.1. 


4.  Application  to  LCP(M,  q) 

We  now  consider  an  application  of  Corollary  3.5  to  LCP(M,  q)  in  the  case 
when  M  is  positive  semidefinite.  From  (c)  of  Corollary  3.5,  the  solution 
of  LCP(M,  q)  is  reduced  to  the  solution  of  the  sequence  LCP(M  +  enI,q). 
We  shall  not  be  concerned  here  with  an  algorithm  for  the  solution  of  the 
positive  definite  LCP(M  +  enI,q).  However,  we  would  like  to  show  that 
if  the  solution  set  S(M,q)  is  bounded  then  for  any  preassigned  tolerance  6, 
it  suffices  to  solve  LCP(M  +  el,q)  for  a  single  value  of  the  parameter  e 
to  obtain  a  6 -approximate  solution.  We  make  this  precise  in  the  following 
Theorem. 


4.1  Theorem.  Let  6  >  0  be  a  preassigned  tolerance.  Assume  that  M  is 
positive  semidefinite  and  that  S{M,  q)  is  nonempty  and  bounded.  Then 
there  exists  e  >  0  such  that  Ve,  0  <  e  <  e,  the  unique  solution  z(e)  of 


-  ■  f  .  -4;  .>£■ 


> .fX  -Ur  *~«T 
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LCP(M  +  el,  9)  satisfies 

x(e)  >  0,  ||u;{£:)  -  u>(£)+ j|  <  6  and  \  <  x(e),  tu(e)  >  |  <  6 

where  tv(e)  =  Mx(e)  +  q. 

Proof 

Assume  that  x{e)  solves  LCP( Af  +  el,q).  Let  c(e)  =  w(e)  +  ex(e).  By 
assumption,  3K  >  1  such  that  ||5(Af,  q)\\  <  K.  Now  choose  e  =  6/K2. 
Since  x(e)  solves  LCP(M  +  el,q ),  we  have 

x(e)v(e)  =  0,  v(e)  -  u;(e)  =  ex(e). 

If  x*  is  the  least  two-norm  solution  of  LCP(M ,  q) ,  then 

|x(e)u>(e)|  =  e||x(e)|j2  <  K  e  ||x(e)|  (by  3.5(a)  and  (c)) 

<  K  ?j|x*||  (by  3.5(a)  and  (c)) 

<  K2 -6/K2 

=  6. 

Also  since  u>(e)+  is  the  closest  point  to  w(e)  in  SR” ,  we  have 
||t«(e)  -  w(e)+||  <  ||w(e)  -  w(e)||  =  e  •  ||*(e)|| 


Remark 


We  remark  that  a  sufficient  condition  for  the  boundedness  of  the  solution  set 
is  that  the  interior  of  the  feasible  set  S(M,q)  be  nonempty  (see  for  instance 
[Mangasarian,  1982]  where  this  is  proved  for  the  more  general  case  when  Af  is 
copositive  plus,  that  is,  (i)  x  >  0  =>  xMx  >  0  and  (ii)  xMx  =  0  =>  Mx  =  0.) 
To  find  the  constant  K  one  can  use  the  bounds  obtained  by  Mangasarian 
[1985]  by  solving  a  single  linear  program  if  necessary. 
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tation  at  the  University  of  Wisconsin-Madison  written  under  the  supervision 
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